Slow Stochastic Switching by Collective Chaos of Fast Elements 
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Coupled dynamical systems with one slow element and many fast elements are analyzed. By 
averaging over the dynamics of the fast variables, the adiabatic kinetic branch is introduced for the 
dynamics of the slow variable in the adiabatic limit. The dynamics without the limit are found 
to be represented by stochastic switching over these branches mediated by the collective chaos of 
the fast elements, while the switching frequency shows a complicated dependence on the ratio of 
the two timescales with some resonance structure. The ubiquity of the phenomena in the slow-fast 
dynamics is also discussed. 



Dynamics with distributed timescales are ubiquitous 
in nature, not only in physicochemical and geophysical 
systems but also in biological, neural, and social sys- 
tems. In biological rhythms, for example, dynamics with 
timescales as long as a day coexist and interfere with the 
dynamics of much faster biochemical reactions occurring 
on subsecond timescales A similar hierarchy exists 
even within protein dynamics Electroencephalogra- 
phy (EEG) of the brain is known to involve a broad range 
of frequencies, and the functional significance of multi- 
ple timescales has been extensively discussed [sl-lsl • Neu- 
ral dynamics in higher cortical areas alter our attention 
on a slower timescale and switch the neural activities of 
faster timescales in lower cortical areas. Faster sensory 
dynamics are stored successively in short-term to long- 
term memory. Unveiling the salient intriguing behavior 
that is a result of the interplay of dynamics with different 
timescales is thus of general importance. 

To treat dynamics with fast and slow timescales, 
several theoretical tools have been developed since 
the proposition of Born-Oppenheimer approximation in 
quantum physics. Consider dynamical systems of the 
form 

dyi/dt = Fi{{xj,yj}); edxi/dt = Gi{{xj,yj}), (1) 

where e is small so that {xi} are faster variables than 
{yj}' According to adiabatic elimination or Haken's slav- 
ing principle [6|-l9|, fast variables are eliminated by solv- 
ing dxi/dt = for a given {yj}^ and by using this solu- 
tion of {xi} as a function of {yj}^ closed equations for 
the slow variables are obtained. This is a powerful tech- 
nique when the fast variables are relaxing to fixed points 
for the given slow variables, whereas to include a case for 
which the fast variables have oscillatory dynamics, the 
averaging method is useful 0,[1Q|- That is, the long-term 
average of the fast variables < Xi > is taken for a given 
{^j}, and by inserting the average into the equation for 
{t/j}, a set of closed equations for the slow variables is ob- 
tained. When the number of variables involved is small, 
additional techniques developed with the use of a slow 
manifold can be beneficial Dynamical systems with 
mutual interference between the fast and slow variables 



have also been investigated |12l-ll8j. 



In this Letter, we study a case that involves a large 
number of fast variables which show chaotic dynamics. 
We introduce the adiabatic kinetic plot (AKP) to ac- 
count for the kinetics of the slow variables under the adi- 
abatic limit e ^ by using the averaging method. We 
show that this plot is useful for analyzing the dynamics 
even for a finite, small e for which stochastic transitive 
dynamics over different modes are observed and are ex- 
plained as switches over the adiabatic kinetic branches 
(AKB) obtained from the AKP. This stochasticity in the 
switches is shown to originate from the collective chaos 
of an ensemble of fast variables. 
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Fig. 1. (Color online), (a) An example of the AKP for our 
model (eq.(l)(2)) with iV = 10 and /3 = 10. The AKP is 
computed by fixing the y value at the abscissa and numer- 
ically integrating the equations of the fast variables for 10^ 
time units from 10 randomly selected initial conditions. The 
ordinate < h > is then computed from the temporal average 
of the last 8 x 10^ time units of each initial condition. The y 
value is incremented by 0.005 to obtain the plot, (b) The time 
series of ^ for e = 0.0001. There are two coexisting attractors: 
a fixed point (green) and a limit cycle (red). 
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As a specific example, we consider the case for a single 
slow variable where F = h{{xj}^ v) — y and G{{xj}^ y) 
are chosen from the threshold dynamics as 



N-1 



^ = h{{xj},y)-y = tanh{-j= ^ ( Joj^j + ^oo^)) - ^, 

7 = 1 



= G{{xj}^y) = tanh{ ^ 



N-1 



Jioy)) 



(2) 



(3) 

where P is taken to be 10. Here, Jij is chosen as a ho- 
mogeneous random number in the interval [—1,1], and 
once it is chosen, it is fixed during the dynamics for each 
sample. We have adopted this form because this type of 
threshold dynamics lH, [2o| is used as a simplification of 
neural network [2l| or gene regulation network dynamics 
in which each element (neuron or gene expression) 
tends to take either an "on" {x = 1) or "off" {x = —1) 
state activated {Jij > 0) or inhibited {Jij < 0) by other 
elements. Note, however, that the method and findings 
discussed here are not restricted to the specific choices of 
the functions F and G; they are valid for any choice. 

The dynamics of the slow variable y is represented us- 
ing the averaging method diS dy/dt =< h{{xj}{y)) > —y^ 
where < h{{xj}{y)) > is the temporal average of h for a 
given y, i.e., the average input that y receives from {xj}, 
in the adiabatic limit. To compute the average < • >, we 
first fix the y value, obtain the attractors for Xj, and then 
compute the temporal average for each attr actor. By 
changing the value of y^ < h{{xj}{y) > is obtained, and 
this forms a continuously changing branch. At this point, 
it is useful to introduce the plot (^, < h{{xj}{y)) >) 
(Fig. [T]) If there are multiple attractors that depend on 
the initial condition of Xj , then there are several branches 
in the AKP. Starting from a given y and initial condition 
Xj, the dynamical system falls on a specific branch. Ac- 
cording to the equation for 7/, if < > is larger (smaller) 
than y, then dy/dt > {dy/dt < 0). Thus, we can trace 
the dynamics of y along each branch. When a branch 
crosses the line y =< h then y falls on a fixed point. 
If the slope of the branch at the fixed point is less than 
unity, then the system is attracted to the point so that 
the slow variable falls on a fixed point attractor (at least) 
in the limit of e ^ (see the middle branch in Fig. [T]). 
We have confirmed that this is true up to a certain value 
of e. 

The periodic motion of y can also be explained by the 
AKP. For example, see the top and bottom branches in 
Fig. [TJ As increases along the top branch, it eventually 
reaches the endpoint of the branch and then switches to 
the bottom branch, which corresponds to an alternative 
attractor of x. The process then repeats itself as y de- 
creases along the bottom branch to the endpoint before 



switching to the top branch. Indeed, this periodic oscil- 
lation exists as an attractor, as shown in Fig. [Tfb). In 
this example, the {xj} attractor is a fixed point at each 
branch, but in many other examples, the attractor may 
be a limit cycle or chaos. However, the present analysis 
of the y dynamics is still valid in such cases. In fact, the 
periodic oscillation of y as analyzed from the AKP exists 
up to a certain value of e (e.g., '^0.01), where a small 
amplitude, fast oscillation of order e is added to the slow 
y oscillation, if {xj} exhibits oscillation. 

In general, AKP has much more branches that make 
the oscillatory dynamics complex. A rather more com- 
plicated example is shown in Fig. [21 In this case, in the 
hmit of e ^ 0, ^ switches between two branches. In the 
example in Fig. [3] (a) for e = 2 x 10~^, y periodically 
switches between the branch a+ and a section of branch 
j~ ("4"). For a larger e value, however, complex oscilla- 
tions of y are seen, as shown in Fig. O This is described 
as the switching over all 2 x 10 branches, a^, b^, c^, 

(the first 12 are labeled explicitly in the figure), where 
± denotes the symmetric branches of y > and ^ < 0. 
Here, we should mention that this switching is not always 
deterministic. For example, a+ — > 6+ ("1") or a+ ^ i~ 
("3" "4") are both possible, as are d+ j' ("1" 
^ "2") and d+ e+ ("5" ^ "6"). As e is decreased, 
a larger number of branches is visited by the stochastic 
switches (see Fig. [31(a) to [31(b) and to [3] c)] until only a 
cycle between two branches remains in the limit of e ^ 0, 
as in Fig. [31(a). 

With the complex switches, the dynamics of Xi switch 
among (at least) 2x10 types of attractors including fixed 
points, limit cycles, and chaos. This t^)e of switching is 
reminiscent of chaotic itinerancy 23l426| where the orbit 
itinerates over "attractor ruins". Here, in contrast, the 
stochastic switches progress among attractors for a given 
value of the slow variable y, while the chaotic dynamics 
of the fast variables provides a source for the stochas- 
tic switching. Indeed, at the boundary of the branches 
a,(i, /, • • • , the fast variables {xi} show chaotic oscilla- 
tion. 

For a detailed analysis of the stochastic switching due 
to the chaotic dynamics, we consider the simpler example 
given in Fig. [4] with a different matrix Jij . In this case, 
as e ^ 0, ^ shows periodic oscillation between the two 
branches a+ and a~, whereas for e > ec ^ 0.5 x 10~^, 
the branches 6+ and h~ are also available, and stochastic 



switching 



, 6+ and its symmetric counterpart 



appear. The choice between a+ a~ and a+ 6+ is 
stochastic, and indeed, we have computed the Shannon 
entropy of the n-tuple symbol sequence of the branches 
a, h visited by the slow y variable and confirmed that it 
increases linearly with n {^^ 0.91n)[27|. 

To examine if the origin of the stochasticity lies in the 
chaos of the fast variables, we measured the maximal 
Lyapunov exponent for the (TV — l)-dimensional fast dy- 
namics of {xi} for a given y at each branch. As shown 
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Fig. 2. (Color online) (a) The AKP with = 30 for a given 
J that produces complex oscillation. The AKP is computed 
in the same manner as Fig. [T]but from 3 x 10^ to 3.5 x 10^ 
time units over 20 randomly chosen initial conditions. The 
branches are labeled with lower case letters. Due to the sym- 
metry in the model, branches for y > and y < are indi- 
cated by + and — , respectively. (The branches i and j happen 
to take almost the same < h > value but belong to different 
{xj } attractors) . The numbers correspond to the time course 
plotted in part (b). (b) Time series of the slow variable y for 
e = 0.0001. The numbers (1, 2, • • • , 12) correspond to the 
branches visited there, as displayed in part (a), (c) The time 
series of the fast variables Xi {i — 1, 2, • • • ,9) for the branches 
b, c, and h. 




Fig. 3. (Color online): Time series of the slow variables y 
corresponding to Fig, 2, except for e = 2 x 10~^ (a), e = 
1 X 10"^ (b), and e = 1 X 10"^ (c). The time series of (c) 
corresponds to Fig. 2(b) but is plotted for a longer time span. 
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Fig. 4. (Color online) (a) The AKP computed for a different 
matrix J with N — 20 and the time average between 10^ to 
2 X 10^ time units from 15 initial conditions. The maximum 
Lyapunov exponent of the dynamics of {xi} is also computed 
over the interval of 3 x 10^ to 4 x 10^ time units for each 
branch of a given y. The segment of the branch with positive 
exponent (whose value is about ^ .02) is colored as blue. 
(See Supplementary Fig.l for the Lyapunov exponents at each 
branch), (b) The time series of y for e = 0.001. 



in Fig. m (c), the exponent is positive around the end- 
points of the branches where stochastic switching occurs. 
Several other examples also show stochastic transition- 
ing beyond a critical value of e, a Poisson switching- time 
distribution, and a positive Lyapunov exponent at the 
branch endpoint (for example see Supplementary Figs. 
2). The stochastic switching from the branches a and f 
in Fig. [2] is also explained by the chaotic dynamics of the 
fast {xi] variables at the branches. 



When {xi} shows chaotic dynamics, one might expect 
that the variable h can be regarded as just the noise rep- 
resented by the sum of random {xi} variables. If this 
were the case, then the amplitude of this noise would 
decrease as the number of fast elements N is increased. 
The variable h would then approach a constant in the 
N ^ oo limit, and the frequency of the stochastic switch- 
ings would decrease accordingly. However, this is does 
not occur. We simulated the present model by increas- 
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Fig. 5. (Color online) Frequency of the switching in the 
branches corresponding to the dynamics in Fig. 3] as a func- 
tion of e. For each e value, the number of a+ to b+ switching 
events divided by those from a+ to a- are computed as the 
fraction of the number of times that y goes beyond 0.2 divided 
by the number of times that it goes below within 500 time 
units. 



ing the number of fast elements by 2^ (/c = 1, 2, • • • , 6) by 
cloning the matrix Jij and confirmed that the frequency 
does not decrease with an increase in A^. This suggests 
that there is still some correlation among the fast vari- 
ables X, so that h shows collective chaotic motion, as has 
been studied extensively 28l-[3l|. In fact, the oscillation 
of the collective variable h has a larger amplitude than 
the typical mean- field oscillation in the collective chaos in 



coupled chaotic systems studied thus far [28|,|30|. Indeed, 
some of the fast elements Xi undergo a large- amplitude 
change between the on and off (1 and —1) states and 
there remains correlation among the Xi variables. 

With an increase in e beyond ec, the frequency of 
the stochastic switching increases, but with a further in- 
crease, the frequency shows a complicated dependence 
on e, as it is increased beyond Cc. There are certain pa- 
rameters for which the switching loses its stochasticity 
and is replaced by either perfect switching between two 
original branches in the e ^ limit or perfect switch- 
ing to the new branch (i.e., a+ 6+ only). When the 
switching ratio is zero or unity, the long-term oscilla- 
tion of the slow variable y is periodic. Thus, each such 
"deterministic" region is regarded as a "window" in the 
parameter region showing chaos. Here, it is interesting 
to note that periodic motion is generated between vari- 
ables with timescales differing by more than one order 
of magnitude. In fact, the collective variable h can have 
a slower component than the original timescale e for Xi. 
Complicated resonance structures of the switching ratio 
are often observed in the present system when stochastic 
switchings exist. 

To summarize, we have introduced an AKP to study 
the kinetics of slow variables in the adiabatic limit e ^ 0, 
Up to a certain critical value ec, the slow dynamics fall 
either on a fixed point or exhibit periodic switching be- 
tween branches. As e is increased (i.e., the timescale 
difference is decreased), stochastic switching among sev- 



eral branches appears mediated by the collective chaotic 
motion of the fast variables, and the variety of switchings 
increases with a further increase in e. 

Although we have employed a simplified threshold dy- 
namics model that borrows concepts from neural or gene 
regulation networks, the AKP method can be applied 
generally to fast-slow systems, and stochastic switching 
over the AKB will appear when the fast variables show 
chaotic motion. Extension to a case with multiple slow 
variables is also possible, in principle, by extending each 
branch to a surface or higher-dimensional manifold. Al- 
though visualization in this case will be difficult in com- 
parison with the present AKP, the stochastic transitions 
over adiabatic manifolds can be analyzed using the meth- 
ods developed here. 

As a result of the switching, long-term itinerancy over 
different modes of oscillation of the fast variables ap- 
pears, which is reminiscent of chaotic itinerancy. Ex- 
perimentally, such itinerancy is often observed in EEGs 
of the brain, biorhythms, climate dynamics, and so forth, 
where modes with different timescales coexist [26|. The 
present approach may shed light on such itinerant be- 
havior, while hierarchical construction of AKPs may be 
beneficial to^eal with a system with a variety of distinct 
timescales [14|. 

Collective chaotic motion of fast variables is a source 
of stochastic switching and is modulated by the motion 
of slow variables; such mutual inference between fast and 
slow modes leads to resonance between the slow and col- 
lective modes, which is similar to the interference in the 
neural activity dynamics between higher and lower cor- 
tical areas during changes in our attention. 
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